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Abstract: We give a simple derivation of the distribution of the maximum L of the length of the queue during 
a busy period for the M/M/1 queue with A < 1 the ratio between arrival rate and service rate. We observe 
that the asymptotic behavior of the moments of L is related to that of Lambert series for the generating 
functions for the sums of powers of divisors of positive integers. We show that Ex[L] log(l/(l — A)) and 
¥jx[L^] ^ kl C(fc)/(1 - A)'''^^ for /c > 2, so that Var[L] ^ 3/7r^(l - A). More generally, we show how to obtain 
asymptotic expansions for these moments with error terms of the form 0((1 — A)^) for any N. 
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1. Introduction 

We study the M/M/1 queue (that is, the single server queue with independent exponentially distributed 
interarrival times and independent exponentially distribiited service times). Let A denote the ratio of the 
arrival rate (the reciprocal of the mean interarrival time) to the service rate (the reciprocal of the mean 
service time). When A < 1, the the busy period (the interval during which the service is continuously busy) 
is finite with probability one. Let the random variable L denote the maximum length of the queue during a 
busy period. (We count the customer being served in the queue length, so that L>1 and L = 1 when and 
only when the busy period comprises a single service interval.) It is known that L has the distribution 



see for example Cohen [CI, pp. 191-193]. (Neuts [N] has also treated this question, but does not give a 
simple formula for the distribution.) In Section 2, we shall give a simple derivation of (1.1) based on the 
solution to the "Gambler's Ruin" problem. 

Our main goal in this paper is to give asymptotic expansions for the moments 



Pr[L > Z] = 



(l-A)A' . 
1 - A'+i ' 



(1.1) 



Ex[L'^] =^1'= ¥i[L = l] 



of L in the "heavy traffic" limit as A — >■ 1. Writing 



Afe(rn) = m'= - {m-lf 




for the backward differences of the /c-th powers, and setting 




(1.2) 



m>l 



summation by parts yields 



Ex[i'=] =^l^ Pr[I, 



I] 



l>0 



1) Pr[L > I] 





m>l 




(1.3) 
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Since Ex[i'^] is a linear combination of the Sk{X), it will suffice to determine the asymptotic behavior of the 
sums Sk{X)- 

The sums in (1.2), which are called Lambert series, arise in a natural way in number theory (see for 
example Hardy and Wright [H, p. 257]). We have 

m>l 1>1 

= EE"^'^"" 

1>1 m>l 

= E^"E'^' (1-4) 

n>l d\n 
n>l 

where the inner sum in (1.4) is over integers d dividing n, and crfe(n) denotes the sum of the k-ih powers of 
the divisors of n (see Hardy and Wright [H, p. 239]). Thus Sk{)^) is the generating function for (Tfe(n). 

We note that the Lambert series 5"^ (A) can be expressed in terms of known (albeit exotic) functions of 
analysis. We define the g-gamma function by 

r,(.) = (i-«)-^nTT7^ 

n>0 ^ 

(see for example Gasper and Rahman[G, p. 16]). (This function gets its name from the fact that 
\\mq^iTq{x) = r(x), where T{x) is the Eulcr gamma function; see for example Whittaker and Watson 
[W, pp. 235-264].) If we define the g-digamma function ^q{x) as the logarithmic derivative 

qu+x 



= - log(l - g) + logg ^ _ 

n>0 ^ 

of the g'-gamma function, then we have 

V>;,(l) + log(l-A) 

= to^A • 

To go further, we define the A;-th g-polygamma function as the fc-th derivative 

(^)=fl:Vv',(^) 



dx _ 

of the g-digamma function. If we set z = g""*""^, then 

d\ rid 



z- 



dz J \ log q dx 
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Since 



we have 



E 



dz j 1 — z 



m>l 

1 f 



E^fc {n+x)m __ 



m>l 



Summing over n > yields 



™ g _ \^ ^fc \^ „m(n+a:) 



y - 

m>l m>l n>0 



^ m'^ 
1 / 5 



V^x / ^ 1 - 

^ ^ n>0 ^ 



1 f d \ '' %l>q{x) +log(l - q) 



log^q \dxj logg 



Thus for /c > 1 we have 



V'f (1) 
log'^+i A 



In Section 3, we shall begin our study of the asymptotic behavior of the moments of L, deriving the 
leading terms 

Ex[L]~log^, (1.5) 

and, for fc > 2, 

ML"] ~ (1.6) 

where ({k) = J2n>i ^1"^ is the Riemann zeta function. It will be noted that Ex[iy] grows quite slowly as 
A — > 1. If the random variable K denotes the length of the queue in equilibrium, then Ex[/f] = A/(l — A), 
which grows much more rapidly (see Cohen [C], p. 181). It may appear paradoxical that the maximum 
queue length grows more slowly than the mean queue length, but it must be borne in mind that Ex[I/] is 
an average over busy periods, whereas Ex[/f ] is an average over time. Indeed, the majority of busy periods 
have L = 1: after the arrival initiating the busy period, the next event determines whether L = 1 (if that 
event is a service termination) or i > 1 (if that event is another arrival). Because A < 1, the former (with 
probability 1/(1 — A)) is more likely than the latter (with probability A/(l — A)). We also note that, since 
C(2) = 7r^/6, we have Var[i] = Ex[i^] - Ex[i]^ ~ 7r^/3(l - A), which grows much more rapidly than Ex[i] 
(or even Ex[i]^). 

In Section 4, wc shall refine these results by showing how to obtain complete asymptotic expansions for 
the moments Ex[_L'^] as A — > 1. We obtain error terms of the form 0((1 — A)'^) for any c. These refinements are 
obtained by methods recently introduced in rigorous quantum field theory. All our results can be extended 
to the MjMj s queue (with s independent and identical servers), if the busy period is defined as a contiguous 
interval during which all s servers are busy, and A is the ratio of the arrival rate to s times the service rate 
for each server; for simplicity we confine our attention to the case s = 1. 
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2. The Distribution 

In this section, we shall give a simple derivation of the formula (1.1). Consider a game played between 
two players: P, who begins with v dollars, and Q who begins with w dollars. At each step of the game, a 
biassed coin is tossed; P wins with probability p, in which case Q pays P one dollar, and Q wins with the 
complementary probability q — 1 — p, in which case P pays Q one dollar. The game continues until one of 
the players is ruined (that is, has no money left). It is known that (1) with probability one, either P or Q 
is eventually ruined, and (2), \{ p ^ q, then the probability that Q is ruined is 

(qIvY - 1 

Pr[0 ruined] = , ^^/'^' (2.1) 

(see for example Feller [F, p. 345]). 

Now consider a busy period of the M/M/1 queue. The successive events of arrivals and terminations 
of service intervals during the busy period correspond to steps in the game described above. The wealth of 
player P will correspond to the length of the queue at each step, so v = 1. An arrival will correspond to 
a win by player P, so p = A/(l + A), and the termination of a service interval will correspond to a win by 
player Q, so q = 1/(1 + A). Suppose that player Q begins with w = I dollars. Then the event L > I will 
correspond to Q being ruined. Substituting these values in (2.1) yields (1.1). 

This correspondence also shows what happens for A > 1. For A = 1 (in which case the busy period is 
finite with probability one, but its expected length is infinite), we have take p = q = 1/2, and have 

V 

Pr\Q ruined! = . 

V + w 

This result yields 

Pr[X>^] = ^, 

so that 

Ex[L] = ^Pr[L > ;] (2.2) 

l>0 

diverges logarithmically. Of course, for A > 1 (in which case the busy period is infinite with positive 
probability), (2.1) shows that (2.2) diverges linearly. 

3. The Leading Terms of the Moments 

In this section, we shall derive the leading terms (1.5) and (1.6) of the asymptotic expansions for the 
moments of L. We begin by deriving the leading terms of the asymptotic expansions for the sums 

and, for j >1, 

Once these formulas are established, it will be clear that the sum in (1.3) is dominated by the term for which 
j = fc - 1, so that Ex[L*] ~ kSk-i{X), and (1.5) and (1.6) follow from (3.1) and (3.2), respectively. 



■ log ■ 



1-A °1-A 



i!C(i + i) 

(1 - A)J+i ■ 



(3.1) 
(3.2) 
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Our strategy for proving (3.1) and (3.2) will be to approximate the sums Sj{X) by integrals 

then then to show that the difference Sj (A) — Ij (A) is negligible in comparison with Ij ( A) . It will be convenient 
to write A = e~^. The limit A — > 1 then corresponds to /i — > 0. We have 

h = \ogj 
= log 



l-(l-A) 

1 - A. (3.3) 



For J = 0, we have 



-I s^"^ 



1>1 



g-hl 

^ hi 

1>1 " 

1 V — 

T 

1>1 

— log . 

h ^ 1-A 



Substituting (3.3) in this result yields 



/o(A)~^log^. (3.4) 



We bound |S'o(A) — /o(A)| by the total variation of f{x) = A'^7(l — A^). Since f{x) decreases monotonically 
from A/(l — A) to as a; increases from 1 to oo, we have |5'o(A) — /o(A)| < A/(l — A) ~ 1/(1 — A). Since this 
difference is negligible in comparison with (3.4), we obtain (3.1). 

For j > 1, we have 

°° x^ A^ dx 



°° {y + ly A'^+i dy 



Jo 1 







E 

Q<i<j 



1 _ xv+i 



•^0 o<i<j 1>1 



oo 



0<i<j ^ ' i>l 
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0<i<i ^ ' i>l 



E 



^ {hiy+'^ 



0<i<j ^ ^ 1>1 



0<i<j ^ ' 1>1 

= E (•l/^^rLi.+xCA), (3.5) 

where Life(A) = J2n>i ^ 1"^^ is the fc-th polylogarithm. Since Lii(A) = log(l/(l — A)) and Li/j(A) — > Q(k) as 
A — >^ 1 for fc > 2, the sum in (3.5) is dominated by the term for which i = j, and we have 

i!C(i + i) 



+ (3.6) 



(1 - A)J+i 

We bound |5j(A) — Ij{X)\ by the total variation of f{x) = A'^/(l — A"^) for < a; < oo. As a; increases, f{x) 
increases monotonically from to a maximum, then decreases monotonically to 0. Thus the total variation 
of f{x) is twice the maximum. This maximum is 

max f{x) = max 



0<a;<oo 0<x<oo 1 



= max 



0<a;<oo e''^ — 1 

1 

max 



hi o<y«x - 1 

Furthermore, y^/ie^ - 1) < j!, because - 1 = E„>i 2/"/"' > J/Vj!- Thus \Sj{X) - Ij{X)\ < 
2maxo<j:<oo /(a;) < '^j^-fh^ ~ 2jV(1 — A)-'. Since this difference is negligible in comparison with (3.6), 
we obtain (3.2). 



4. The Complete Asymptotic Expansions 

In this section we shall show how asymptotic expansions, with error terms of the form 0((1 — A)^) 
for any N, can be derived for all of the moments Ex[L'^]. The essence of the argument is to use the Euler- 
Maclaurin formula to estimate the difference between Sj{X) and Ij{X). This is most conveniently done using 
a result of Zagier [Z]. Indeed, for i > 1, Zagier gives the expansion for Sj{X), in terms of the parameter 
h = — log A rather than 1 — A. All that remains for us to do is substitute an expansion for h in terms of 1 — A. 
For j = 0, the expansion for 5*0 (A) in terms of h has been given by Eggcr (nc Endrcs) and Steiner [El, E2], 
again using the result of Zagier. We shall proceed differently, to obtain an expansion involving — log(l — A) 
rather than — log h. 

Proposition: (Zagier [Z, p. 318]) Let f{x) be analytic at a; = 0, with power series f{x) = X]n>o^"^" about 
a; = 0. Suppose that /g°° |/^^^(a;)| dx < oo for all N >0, where f^^\x) denotes the N-th derivative of f{x). 
Define // = Jq°° f{x) dx. Let g{x) = J2m>i /("^^)- Then g{x) has the asymptotic expansion 

n>0 ^ ' 
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where B). is the fc-th BernouUi number, defined by t/ (e* — 1) = X^fe>o t'^/kl. 
This result is proved by using the Euler-Maclauren formula, 

"'^ l<m<M-l l<n<N-l ^ 



+ (-1)"/ f'^^'y^^dy, 

JO 

where Bh(y) is the fc-th Bernoulli polynomial, defined by fe^*/(e* — 1) = Xlfe>o ^k{y) /k\, and {y} = y—\_y\ 
denotes the fractional part of y . (For the Euler-Maclauren formula, the Bernoulli numbers and the Bernoulli 
polynomials, see for example; Whittaker and Watson [W, pp. 125 128], where, however, the indexing of the 
numbers and polynomials is different.) The condition \f^^\y)\dy < oo allows us to let M — )• oo, 
obtaining 

r m dy=Y, f{m) + ^^^^ /^"HO) + (-1)" r f^^^Ky)^^ dy. 

"'O m>l 0<n<N-l ^ ~^ Jo 

If we now write f{xy) instead of f{y), we obtain 

r f{xy)dy=Y,f{mx)+ ^ ^'Z +'^17' /^"H") ^" + (-^)'' C /^^H^^)^^ dy. 
Changing the variable of integration from y to y/x then yields 

•'0 m>l 0<n<N-l V "T J- Jo 

The integral on the left-hand side id //, the first sum on the right-hand side is g{x), /'^"•'(O) = n! 6„, and the 
last term on the right-hand side is 0{x^~^). Thus 

0<n<Af-l ^ 

which yields the expansion (4.1). 
For j > 1, we define 

Then /(a;) is analytic at a; = with the Taylor series 

R ™Tl+j-l 

/(-) = E^^^ 

and the integral 

= i!C(j + i) 
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(see for example Whittaker and Watson [W, p. 266]). Furthermore, /^^^(a;) is a rational function of x and 
e^, in which the degree of the numerator in is while the denominator is (e^ — l)^"*"""^. Thus f{x) 
satisfies the conditions of the proposition, and we have the asymptotic expansion 

n\{n + j) 

Recalling that A = e~^, so that h = — log A, we therefore have 



m>l 

(mhy 



ho ^ 



W ^ e'*™ - 1 



m>l 



m>l 



We note that, if j is odd, then this expansion has only finitely many terms (because -B„ = for odd n > 3). 
To obtain an asymptotic expansion in terms of 1 — A, we must substitute the expansion for 1/h: 

1 1 



h — log A 

-1 



log(l - (1 - A)) 

1 -(1-A) 



1 - A log(l - (1 - A)) 

n>0 

where Ck is the fc-th Bernoulli number of the second kind, defined by t/ log(l + t) = J2k>o t''/k\ (see for 
example Roman [R, p. 116]). (These numbers are also called the Cauchy numbers of the first kind, and are 
given by Ck — Jq x{x — 1) • • • (x — fc + 1) dx; see for example Comtet [C2, pp. 293-294].) 

For J = 0, we must proceed differently, because 

1 



has a pole at a; = 0. We define 



r{x) = f{x)-^ 

1 e- 



— 1 X 

Then /* (a;) is analytic at a; = with the Taylor series 

in + lj 



r(x)-vl^i^±i-i^l^"" 



n>0 
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and the integral 

//» = / ( — ^ -—] dx 







X 
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(see for example Whittaker and Watson [W, p. 246]). Furthermore, f*^^\x) is a rational function of x and 
e^, in which the degree of the numerator in is N, while the denominator is ((e^ — l)a;)^^^. Thus f*{x) 
satisfies the conditions of the proposition, and we have the asymptotic expansion 



n>0 

We therefore have 



(n + 1) (n + 1)! 



5, 



'o(A) = E r 



m>l 



^ m/i ^ e™'' - 1 m/i 

m>l m>l 
m>l 



1 10, J_ + 2 + V (-^)" ^»+^ (^"+^ - (-^)"^^) ^" (44) 

(n + 1) (n + 1)! ' 



n>0 



To obtain asymptotic expansions for the moments of L, we substitute (4.3) into (4.2) and (4.4), then 
substitute the results into (1.3), using the expansion 

1-A 1-A 



A l-(l-A) 



n>l 



Retaining only terms that do not vanish as A — ?► 1, we obtain 

Ex[L] = log ^ + 7 + O [(1 - A) log ^ 



and 



= W^) + log + (7 - 1) + o - ^) log T^) 



for the first two moments. Thus we have 
Var[i] = Ex[L2] _ Ex[L]2 

log^ -1- + (1 - 27) log -1- - 7^ + O ( (1 - A) lo, 



6(1 -A) 1-A ' " '"l-A ' V ' ^ 1-A 
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